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Abstract 

An algorithm is constructed that, when given an explicit presentation 
of a finitely generated nilpotent group G, decides for any pair of endomor- 
phisms (p,ij) : G — > G and any pair of elements u,v G G, whether or not the 
equation (x<p)u = v(xijj) has a solution x G G. Thus it is shown that the 
problem of the title is decidable. Also we present an algorithm that pro- 
duces a finite set of generators of the subgroup (equalizer ) Eq v ^(G) < G 
of all elements u G G such that uip = uip. 
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1 Introduction 

Let G be a group, and u,v £ G. Given an endomorphism ip 6 End(G), one 
says that u and v are ip— twisted conjugate, and one writes u ~ v v, if and only 
if there exists x G G such that u = {xtp)~ 1 vx, or equivalcntly [xip)u = vx. 
More generally, given a pair of endomorphisms tp,ip G End{G), one says that 
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the elements u,v are tp,ip— twisted conjugate, and one writes u ~ip^ v, if and 
only if there exists an element x G G such that 

(xtp)u = v(xip)- (1) 

The recognition of twisted conjugacy classes with respect to a given pair of 
endomorphisms (p, ip G End(G) in the case of any finitely generated nilpotent 
group G is the main concern of this paper. 

2 Preliminary results 

It is well known (see, for example, [2], [4]) that most of algorithmic problems for 
finitely generated nilpotent groups are decidable. In particular, the standard 
conjugacy problem is decidable in any finitely generated nilpotent group pQ. 
Some undecidable problems exist too. The endomorphism (see [5]) and the 
cpimorphism (see [3]) problems are among them, as well as impossibility to 
decide if a given equation has a solution in a given finitely generated nilpotent 
group (see [5]). 

For the purpose of this paper we need in the following result of special 
interest. 

Proposition 2.1. Let G be a finitely generated nilpotent group. Let cp,ip £ 
End(G) be a pair of endomorphisms of G. Then there is an algorithm which 
finds a finite set of generators of the subgroup (equalizer) 

Eq v ^{G) = {xe G\x<p = x^j}. (2) 

Proof. Let G be abelian. Then Eq v ^(G) = ker(ip — ip), thus there is a standard 
procedure to find a generating set for it. 

Let G be a finitely generated nilpotent group of class c + 1 > 2. Suppose 
by induction that there is an algorithm which finds for any finitely generated 
nilpotent group H of class < c and any pair of endomorphisms a, /? £ End(H) 
a finite set of generators of the equalizer Eq a ^(H). 

Let C = 7 C (G) be the last non trivial member of the lower central series of 
G. Then the quotient H = G/C has class c. Since C is invariant for every endo- 
morphism of G we can consider the induced by <p, ip £ End(G) endomorphisms 
Cp,%jj G End(H). By the assumption we can construct a finite set of generators 
of the equalizer Eq^ $(H) < H. Let G\ be the full preimage of Eq^ $(H) in G. 
We call Gi a G— equalizer of ip, i[>, and we write Gi = Eqc,<p,$(G). By definition 

Eqc, v ,ii,(G) = {g G G\gip = c g (gip), where c g G G}. (3) 

Obviously, Eq v ^(G) < Eqc,<p,${G), and G < Eq c ^^(G). 
Now we define a map 

M : Eqc,<p,iji(G) G by = c g . (4) 
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Easily to see that this map \x is a homomorphism, and that the derived 
subgroup {Eqc,(p,^(G))' lies in ker{p). 

We conclude that Eq tp ^(G) = ker(p). So, a generating set for Eq v ^{G) can 
be derived by the standard procedure. 

□ 

3 The twisted conjugacy problem for pairs of 
endomorphisms 

Let G be a finitely generated group, and tp, ip £ End(G) be any pair of endo- 
morphisms. Let u ^tp,^ v be a pair of tp, ip— twisted conjugate elements of G. 
We write {u} v ^ for the tp, ip— twisted conjugacy class of element u £ G. 

The question about tp, ^—twisted conjugacy of given elements u,v £ G can 
be reduced to the case where one of the elements is trivial. To do this we change 
tp to tp' = tp o a u , where o u 6 Aut{G) is the inner automorphism h >— > u hu. 
Hence (xtp)u = v(xip) if and only if 

xtp' = w(xip), (5) 

where w = u~ l v. 

Now we are ready to prove our main result about twisted conjugacy in finitely 
generated nilpotent groups. 

Theorem 3.1. Let G be a finitely generated nilpotent group of class c > 1. 
Then there exists an algorithm which decides the twisted conjugacy problem for 
any pair of endomorphisms tp,ip £ End{G). 

Proof. Induction by c. For c = 1 (abelian case) the statement is obviously true. 

Suppose that the statement is true in the case of any finitely generated 
nilpotent group N of class < c — 1. 

Let u,v £ G be any pair of elements, and tp,tp £ End(G) be any pair of 
endomorphisms. We change tp to tp' = tp o a u , and write the equation (J5]) with 
w = u~ l v, as were explained above. Since the last non trivial member C of 
the lower central series of G is invariant for every endomorphism, we decide 
the twisted conjugacy problem in G/C with respect to the induced by tp',ip 
endomorphisms tp, ip £ End(G/C) and the induced by w element w £ G/C. 
More exactly, we decide if there exists an element x £ G/C for which 

xtp' = w(xip). (6) 

By our assumption we can decide this problem effectively. If such clement x 
does not exist the element x does not exist too. 

Suppose that x exists. Then there is an element x\ £ G for which 



X\tp' = cg{x\ip), 



(7) 
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where c G C. If x-x^p 1 = c'g^VO f° r some element 12 6 G and d £ C, we derive 
that 

(xa ^iV = (8) 

where c" = (c') _1 c € C. Thus .t^ 1 ^! G Eqc lip <^(G). In the case when £ 2 = x 
is a solution of ([5]) we have c" = c. Conversely, the equality c" = c means that 
there is a solution x of ([5]). 

By Proposition [2J] we construct a finite generating set of Eq^, ^(G/C), and 
so we can construct a finite generating set of its full preimage: 

Eqc,ip^{G) = gp(g!,...,gi). (9) 

Thus we have 

= Ci(giip), (10) 

where c 2 ; £ C for i = 1, Z. 

Then we apply a the homomorphism defined by the map gi 1— » q for 
i = 1, As we noted above, 1 ~ v ,i/> w if and only if the element c belongs 

to the image (Eqc, v > ^,(G))fi = gp(c\, ...,q). So, our problem is reduced to the 
membership problem in a finitely generated abelian group C. It is well known 
that this problem is decidable. □ 



References 

[1] N, Blackburn, Conjugacy in nilpotent groups, Proc. Amcr. Math. 
Soc, 16 (1965), 143-148. 

[2] M.I. Kargapolov, V.N. Remeslennikov, N.S. Romanovskii, V.A. Ro- 
man'kov, V.A. Churkin, Algorithmic questions for o-powered groups, 
Algebra and Logic, 8 (1969), 364-373. 

[3] V.N. Remeslennikov, An algorithmic problem for nilpotent groups and 
rings, Siberian Math. J, 20 (1979), 761-764. 

[4] V.N. Remeslennikov, V.A. Roman'kov, Algorithmic and model theo- 
retic problems in groups, J. Soviet Math. 21 (1983), 2887-2939. 

[5] V.A. Roman'kov, About unsolvability of problem of endomorphic re- 
ducibility in free nilpotent groups and free rings, Algebra and Logic, 
16 (1977), 310-320. 



